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© METHOD AND APPARATUS FOR CODING VIDEO SIGNAL, AND METHOD AND APPARATUS FOR 
DECODING VIDEO SIGNAL. 



© A timo-varying imago coding dovico for coding 
timo-varying imago signals and a timo-varying do- 
coding device for decoding time-varying image sig- 
nals. The image signals of high resolution are 
thinned by means of a spatial filtering with a given 
resolution in such a way that the aspect ratio is 
^ different, so as to generate image signals of low 
If} resolution. Predicted image signals of image signals 
CO of high resolution are generated by means of a 
IT> spatial filtering with a given resolution so that the 
(v> aspect ratio of the signals generated by decoding 
^ decoded signals of the image signals of low resolu- 
tion is equal to the original one. The image signals 
q of high resolution are coded by use of the predicted 
image signals thus generated. The time-varying im- 
^ age decoding device generates predicted image sig- 
nals of image signals of high resolution by means of 
a spatial filtering with a given resolution in such a 



way that tho aspoct ratio of tho docodod signals 
obtained by decoding tho codod signals of imago 
signals of low resolution is equal to the original one, 
and generates the image signal of high resolution by 
predictively decoding the coded signals by use of 
the predicted image signals thus generated. 
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Technical Field 

This invention relates to a picture signal coding 
method and a picture signal coding apparatus, and 
a picture signal decoding method and a picture 
signal decoding apparatus suitable when used in 
the case of recording a moving picture signal onto 
a recording medium, e.g.. a magneto-optical disc 
or a magnetic tape, etc. to reproduce the recorded 
moving picture signal to display it on a display, 
etc., or in the case of transmitting a moving picture 
signal from the transmitting side to the receiving 
side through a transmission path to receive it on 
the receiving side to display it. etc. in television 
conference systems, television telephone systems, 
or broadcasting equipments, etc. 

Background Art 

A coding method and a decoding method in 
which coding in a hierarchical form (hereinafter 
simply referred to as hierarchical coding) is not 
applied will be first described, and a coding proce- 
dure in the case where hierarchical coding is car- 
ried out will be then described. 

For example, in systems for transmitting a 
moving picture signal to remote place, e.g.. in 
television conference system, or television tele- 
phone system, etc., a picture signal is coded in a 
compressed manner by making use of the line 
correlation or interframe correlation between video 
signals for the purpose of efficiently utilizing trans- 
mission path. 

In the case of utilizing the line correlation, a 
picture signal can be compressed by allowing it to 
undergo, e.g., DCT (Discrete Cosine Transform) 
processing, etc. 

Moreover, when the interframe correlation is 
utilized, a picture signal can be coded in a further 
compressed manner. For example, when frame 
pictures PC1, PC2, PC3 are assumed to respec- 
tively take place at times t = t1, t2, t3 as indicated 
by A of FIG. 22, a difference between picture 
signals of frame pictures PC1 and PC2 is cal- 
culated to generate picture PC12 as indicated by B 
of FIG. 22. Moreover, a difference between frame 
pictures PC2 and PC3 of A of FIG. 22 is calculated 
to generate picture PC23 of B of FIG. 22. Since 
pictures of frames adjacent in point of time ordinar- 
ily have not so great change, when a difference 
therebetween is calculated, its difference signal 
takes a small value. Namely, in picture PC1 2 des- 
ignated at B of FIG. 22, a signal of the portion 
indicated by slanting lines in the figure of picture 
PC12 of B of FIG. 22 is obtained as a difference 
between picture signals of frame pictures PC1 and 
PC2 of A of FIG. 22. In addition, in picture PC23 
designated at B of FIG. 22, a signal of the portion 



indicated by slanting lines in the figure of picture 
PC23 of B of FIG. 22 is obtained as a difference 
between picture signals of frame pictures PC2 and 
PC3 of A of FIG. 22. In view of this, if this dif- 
5 ference signal is coded, a quantity of codes can be 
compressed. 

However, even if only the difference signal is 
transmitted, it is unable to restore original picture. 
In view of this, pictures of respective frames are 
to caused to be any one of three kinds of pictures of I 
picture (Intra-coded picture), P picture (Predictive- 
coded picture) and B picture (Bidirectionally-coded 
picture), thus to encode a picture signal in a com- 
pressed manner. 
75 Namely, as indicated by A and B of FIG. 23, 

for example, picture signals of frames F1 to F17 
are caused to be one unit of processing as group 
of pictures. Picture signal of the leading frame F1 
is coded as I picture. The second frame F2 is 
20 processed as B picture, and the third frame F3 is 
processed as P picture. Then, frames F4 to F17 of 
the fourth frame and frames subsequent thereto are 
alternately processed as B picture or P picture. 
As a picture signal of I picture, picture signal of 
25 that one frame is transmitted as it is. On the 
contrary, as a picture signal of P picture, fun- 
damental, as indicated by A of FIG. 23. a dif- 
ference from a picture signal of I picture or P 
picture preceding in point of time to that signal is 
30 coded to transmit it. Further, as a picture signal of 
B picture, fundamentarily, as indicated by B of FIG. 
23. a difference from a mean value of both a frame 
preceding in point of time and a frame succeeding 
in point of time is determined to encode its dif- 
35 ference to transmit it. 

A and B of FIG. 24 show the principle of a 
method of coding a moving picture signal in this 
way. It is to be noted that data of frame of a 
moving picture video signal and frame data trans- 
40 mitted are respectively shown, in a model form, in 
A and B of FIG. 24. As shown in FIG. 24. since the 
first frame F1 is processed as I picture, i.e., non- 
interpolated frame, it is transmitted to transmission 
path as transmit data F1X (transmit non-interpo- 
45 lated frame data) as it is (intra-coding). On the 
contrary, since the second frame F2 is processed 
as B picture, i.e.. interpolated frame, a difference 
from a mean values of frame F1 preceding in point 
of time and frame F3 succeeding in point of time 
50 (non-interpolated frame of interframe coding) is cal- 
culated. Thus, its difference is transmitted as trans- 
mit data (transmit interpolated frame data) F2X. 

The processing as B picture will now be de- 
scribed in more detail. There exist four kinds of 
55 modes switchable in macro block units. The first 
processing is processing for transmitting data of 
original frame F2 as transmit data F2X as it is as 
indicated by arrow SP1 of broken lines in the figure 
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(intra-coding mode). This first processing is pro- 
cessing similar to that in the case of I picture. The 
second processing is processing for calculating a 
difference from frame F3 backward in point of time 
to transmit that difference as indicated by arrow 
SP2 of broken lines in the figure (backward predic- 
tive mode). The third processing is processing for 
transmitting difference from frame F1 preceding in 
point of time as indicated by arrow SP3 of broken 
lines in the figure (forward predictive mode). In 
addition, the fourth processing is processing for 
generating a difference from a mean value of frame 
F1 preceding in point of time and frame F3 suc- 
ceeding in point of time as indicated by arrow SP4 
of broken lines in tho figure to transmit it as trans- 
mit data F2X (bidirectionally predictive mode). 

A method in which a quantity of transmit data 
is minimum of these four methods is employed in 
macro block units. 

It is to be noted that, at the time of transmitting 
difference data, motion vector x1 from picture (pre- 
dictive picture) of frame subject to calculation of 
difference (motion vector between frames F1 and 
F2 in the case of forward prediction), motion vector 
x2 therefrom (motion vector between frames F3 
and F2 in the case of backward prediction), or both 
motion vectors x1 and x2 (in the case of bidirec- 
tional prediction) is or are transmitted along with 
difference data. 

Moreover, with respect to frame F3 of P picture 
(non-interpolated frame of interframe coding), by 
using frame F1 preceding in point of time as pre- 
dictive picture, a difference signal (indicated by 
arrow SP3 of broken lines) between the frame F3 
and the frame F1 and motion vector x3 are calcual- 
ted. They are transmitted as transmit data F3X 
(forward predictive mode). Alternatively, data of 
original frame F3 is transmitted (indicated by arrow 
SP1 of broken lines) as transmit data F3X as it is 
(intra-coding mode). In this P picture, how an opti- 
mum one of data transmitting methods is selected 
is similarly to that in the case of B picture. A 
method in which a quantity of transmit data is 
minimum is selected in macro block units. 

It is to be noted that frame F4 of B picture and 
frame F5 of P picture are processed similarly to 
the above, whereby transmit data F4X, F5X, motion 
vectors x4, x5, x6, etc. are obtained. 

FIG. 25 shows an example of the configuration 
of an apparatus for coding a moving picture signal 
on the basis of the above-described principle to 
transmit a coded signal to decode it. Coding unit 1 
encodes an inputted video signal to transmit a 
coded signal to recording medium 3 as transmis- 
sion path to record it thereonto. On the other hand, 
decoding unit 2 reproduces the signal recorded on 
recording medium 3 to reproduce it to decode the 
reproduced signal to output decoded signal. 



Initially, in the coding unit 1, video signal VD 
inputted through input terminal 10 is inputted to 
pre-procgssing circuit 11, at which it is separated 
into luminance signal (component) and color signal 

s (component) (color difference signal in the case of 
this example). They are caused to undergo A/D 
conversion at A/D converters 12, 13, respectively. 
Video signals caused to be digital signals after 
undergone A/D conversion by A/D converters 12, 

10 13 are delivered to frame memory 14, at which 
they are stored. At this frame memory 14, lu- 
minance signal is stored into luminance signal 
frame memory 15. and color difference signal is 
stored into color difference signal frame memory 

16 16. 

Format converting circuit 17 converts a signal 
of frame format stored in frame memory 14 into a 
signal of block format. Namely, as indicated by (A) 
of FIG. 26, video signal stored in the frame mem- 

20 ory 14 is caused to be data of frame format in 
which V lines of H dots per each line are gathered. 
Format converting circuit 17 divides this signal of 
one frame into N slices with 16 lines being as a 
unit. Then, respective slices are divided into M 

25 macro blocks as indicated by (B) of FIG. 26. Each 
macro block is constituted by luminance signals 
corresponding to pixels (dots) of 16x16 as indi- 
cated by (C) of FIG. 26. Each luminance signal is 
further divided into blocks Y [I] to Y [4] with 8x8 

30 dots being as a unit as indicated by (C) of FIG. 26. 
In addition, Cb signal of 8 x 8 dots and Cr signal of 
8x8 dots are caused to correspond to luminance 
signal of 16x16 dots. 

As stated above, data converted into block 

35 format is delivered from format converting cicuit 17 
to encoder 18, at which it is encoded. The detail of 
encoding will be described later with reference to 
FIG. 27. 

A signal encoded by encoder 18 is outputted 

40 to transmission path as bit stream, and is recorded 
onto, e.g., recording medium 3. 

Data reproduced from recording medium 3 is 
delivered to decoder 31 of decoding unit 2, at 
which it is decoded. The detail of decoder 31 will 

45 be described later with reference to FIG. 30. 

Data decoded by decoder 31 is inputted to 
format converting circuit 32, at which conversion 
from block format to frame format is carried out. 
Luminance signal of frame format is delivered to 

so luminance signal frame memory 34 of frame mem- 
ory 33. and is stored thereinto. Color difference 
signal is delivered to color difference signal frame 
memory 35. and is stored thereinto. Luminance 
signal and color signal which have been read out 

55 from luminance signal frame memory 34 and color 
difference signal frame memory 35 are caused to 
respectively undergo D/A conversion by D/A con- 
verters 36 and 37. The signals thus obtained are 
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delivered to post-processing circuit 38, at which 
they are synthesized. This output video signal is 
outputted from output terminal 30 to display, e.g., 
CRT, etc. (not shown) to display it thereon. 

An example of the configuration of encoder 18 5 
will now be described with reference to FIG. 27. 

Picture data to be coded which has been deliv- 
ered through input terminal 49 is inputted to motion 
vector detecting circuit 50 in macro block units. 
The motion vector detecting circuit 50 processes 10 
picture data of respective frames as I picture, P 
picture or B picture in accordance with a predeter- 
mined sequence set in advance. Picture types (pic- 
tures of I, P, B) for processing pictures of respec- 
tive frames sequentially inputted are determined in is 
advance. As shown in FIG. 23, for example, group 
of pictures consisting of frames F1 to F17 are 
processed as I, B, P, B, P, • B, P. 

Picture data of frame (e.g., frame F1) pro- 
cessed as I picture is transferred from motion vec- 20 
tor detecting circuit 50 to forward original picture 
section 51a of frame memory 51, and is stored 
thereinto. Moreover, picture data of frame (e.g., 
frame F2) processed as B picture is transferred to 
original picture section (reference original picture 25 
section) 51b, and is stored thereinto. In addition, 
picture data of frame (e.g., frame F3) processed as 
P picture is transferred to backward original picture 
section 51c, and is stored thereinto. 

At the subsequent timing, when picture of 30 
frame to be processed as B picture (e.g., the frame 
F4) or P picture (the frame F5) is further inputted, 
picture data of the first P picture (frame F3) which 
has been stored in backward original picture sec- 
tion 51c up to that time is transferred to forward 35 
original picture section 51a, picture data of the 
subsequent B picture (frame F4) is stored (over- 
written) into original picture section 51b, and pic- 
ture data of the subsequent P picture (frame F5) is 
stored (overwritten) into backward original picture 40 
section 51c. Such operation will be sequentially 
repeated. 

Signals of respective pictures stored in frame 
memory 51 are read out therefrom. At predictive 
mode switching circuit 52, frame predictive mode 45 
processing or field predictive mode processing is 
carried out. Further, under control of predictive 
judging circuit 54, at operation section 53, opera- 
tion by intra-coding mode, forward predictive 
mode, backward predictive mode or bidi recti onally so 
predictive mode is carried out. Which any one of 
these processing is carried out is determine^ in 
macro block units in correspondence with predic- 
tive error signal (difference between reference pic- 
ture to be processed and predictive picture cor- 55 
responding thereto). For this reason, motion vector 
detecting cirucit 50 generates, in macro block 
units, absolute value sum (or square sum) of pre- 



dictive error signals used for this judgment and 
evaluation values of intro-coding mode correspond- 
ing to those predictive error signals. 

Frame predictive mode and field predictive 
mode in predictive mode switching circuit 52 will 
now be described. 

In the case where frame predictive mode is 
set, predictive mode switching circuit 52 outputs 
four luminance blocks Y [1] to Y [4] delivered from 
motion vector detecting circuit 50 to operation sec- 
tion 53 of the succeeding stage as they are. Name- 
ly, in this case, as indicated by A of FIG. 28, there 
results the state whoro data of linos of odd field 
and data of lines of even field are mixed in respec- 
tive luminance blocks. It is to be noted that solid 
lines in respective macro blocks of FIG. 28 indicate 
data of lines of odd field (lines of the first field), 
and broken lines indicate data of lines of even field 
(lines of the second field), and a and b of FIG. 28 
indicate unit of motion compensation. In this frame 
predictive mode, prediction is carried out with four 
luminance blocks (macro blocks) being as a unit, 
and one motion vector is caused to correspond to 
four luminance blocks. 

On the contrary, predictive mode switching cir- 
ucit 52 is operative as follows. Namely, in the case 
where field prediction mode is set, the predictive 
mode switching circuit 52 carries out such a pro- 
cessing to allow a signal of a structure indicated by 
A of FIG. 28 inputted from motion vector detecting 
circuit 50 to be a signal of a structure indicated by 
B of FIG. 28 such that luminance blocks Y [1] and 

Y [2] of four luminance blocks are constituted by 
only dots of lines of odd field, for example, and the 
remaining two luminance blocks Y [3] and Y [4] are 
constituted by data of lines of even field to output 
the signal thus constituted to operation section 53. 
In this case, one motion vector is caused to cor- 
respond to two luminance blocks Y [1] and Y [2], 
and the other one motion vector is caused to 
correspond to the remaining two luminance blocks 

Y [3] and Y [4]. 

It is to be noted that, in the case of frame 
predictive mode, color difference signal is delivered 
to operation section 53 in the state where data of 
lines of odd field and data of lines of even field are 
mixed as indicated by A of FIG. 28. On the other 
hand, in the case of field prediction mode, the 
upper half portions (four lines) of respective color 
difference blocks Cb, Cr are caused to be color 
difference signals of odd field corresponding to 
luminance blocks Y [1] , Y [2], and the lower half 
portions (four lines) are caused to be color dif- 
ference signals of even field corresponding to lu- 
minance blocks Y [3], Y [4]. 

Moreover, motion vector detecting circuit 50 
operates as follows. Namely, this circuit 50 gen- 
erates, in macro block units, evaluation values of 
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intra coding mode for determining whether predic- 
tive mode where prediction is carried out is intra- 
coding mode, forward predictive mode, backward 
predictive mode or bidirectionally predictive mode, 
and whether predictive mode where processing is 
carried out is frame predictive mode or field predic- 
tive mode, and absolute value sum of respective 
predictive errors with respect to respective macro 
blocks in predictive judgment circuit 54. 

Namely, as evaluation value of intra coding 
mode, absolute value sum Z |Aij-(mean value of 
Aij)| of differences between signals Aij of macro 
block of reference picture which is to be coded 
from now and its mean value is determined. Fur- 
ther, as absolute value sum of predictive error of 
forward prediction, sum I |Aij-Bij| of absolute val- 
ues |Aij-Bij| of differences (Aij-Bij) between signals 
Aij of macro block of reference picture and signals 
Bij of macro block of predictive picture in the 
respective frame and field predictive modes is de- 
termined. In addition, absolute value sums of pre- 
dictive errors of backward prediction and bidirec- 
tional prediction are determined respectively in the 
cases of frame and field predictive modes similarly 
to the case of the forward prediction (its predictive 
picture is changed to predictive picture different 
from the case of the forward prediction). 

These absolute value sums are delivered to 
predictive judging circuit 54. The predictive judging 
circuit 54 selects, as absolute value sum of predic- 
tive errors of inter prediction, the minimum one of 
absolute value sums of predictive errors of the 
forward prediction, the backward prediction and the 
bidirectional prediction in the respective frame and 
field predictive modes. Further, absolute value sum 
of predictive errors of inter prediction and evalu- 
ation value of intra coding mode are compared with 
each other to select a smaller one to select mode 
corresponding to the selected value as predictive 
mode and frame/field predictive mode. Namely, if 
evaluation value of intra coding mode is smaller 
than the absolute value sum of predictive errors of 
inter prediction, the intra coding mode is set. In 
contrast, if absolute value sum of predictive errors 
of inter prediction is smaller than evaluation value 
of intra coding mode, mode where corresponding 
absolute value sum is the minimum of the forward 
predictive mode, the backward predictive mode, 
and the bidirectionally predictive mode is set as 
predictive mode and frame/field predictive mode. 

As described above, predictive mode switching 
circuit 52 delivers, to operation section 53, a signal 
of macro block of reference picture of a structure 
as shown in FIG. 28 corresponding to mode se- 
lected by predictive (mode) judging circuit 54 of 
frame predictive mode and field predictive mode. 
Moreover, motion vector detecting circuit 50 out- 
puts a motion vector between a predictive picture 



and a reference picture corresponding to predictive 
mode selected by predictive judging circuit 54 to 
deliver U to variable length coding circuit 58 and 
motion compensating circuit 64 which will be de- 
5 scribed later. It is to be noted that, as motion 
vector, motion vector in which absolute value sum 
of corresponding predictive error is minimum is 
selected. 

Predictive judging circuit 54 sets, as predictive 

10 mode, intra coding mode (mode without carrying 
out motion compensation) when motion vector de- 
tecting circuit 50 is reading out picture data of I 
picture from forward original picture section 51a to 
switch 53d of operation section 53 to contact a 

75 side. Thus, picture data of I picture is inputted to 
OCT mode switching circuit 55. 

As indicated by A or B of FIG. 29, this DCT 
mode switching circuit 55 allows data of four lu- 
minance blocks to be either in the state where lines 

20 of odd field and lines of even field are mixed 
(frame DCT mode) or in the state where lines of 
odd field and lines of even field are separated (field 
DCT mode) to output it to DCT circuit 56. 

Namely, DCT mode switching circuit 55 com- 

25 pares coding efficiency in the case where DCT 
processing is carried out with data of odd field and 
even field being mixed and coding efficiency in the 
case where DCT processing is carried out with 
such data being separated to select mode of higher 

30 coding efficiency. 

For example, as indicated by A of FIG. 29, an 
inputted signal is caused to be of a structure in 
which lines of odd field and even field are mixed to 
calculate differences between signals of lines of 

35 odd field and signals of lines of even field which 
are adjacent in upper and lower directions to fur- 
ther determine sum of their absolute values (or 
square sum). Moreover, as indicated by B of FIG. 
29. an inputted signal is caused to be of a structure 

40 in which lines of odd field and even field are 
separated to calculate differences between signals 
of lines of odd field and defferences between sig- 
nals of lines of even field which are adjacent to 
each other in upper and lower directions to deter- 

45 mine sums of respective absolute values (or square 
sums). Further, both values (absolute sums) are 
compared with each other to set DCT mode cor- 
responding to a smaller value. Namely, if the for- 
mer is smaller, frame DCT mode is set. In contrast, 

so . if the latter is smaller, field DCT mode is set. 

The DCT mode switching circuit 55 outputs 
data of a structure corresponding to the selected 
DCT mode to DCT circuit 56, and outputs DCT flag 
indicating the selected DCT mode to variable 

55 length coding circuit 58. 

As apparent from comparison between 
frame/field predictive mode (see FIG. 28) in the 
predictive mode switching circuit 52 and DCT 
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mode (see FIG. 29) in the DCT mode switching 
circuit 55, data structures in respective modes of 
the both are substantially the same with respect to 
luminance blocks. 

In the case where frame predictive mode 
(mode in which odd lines and even lines are 
mixed) is selected in the predictive mode switching 
circuit 52. there is high possibility that frame DCT 
mode (mode in which odd lines and even lines are 
mixed) may be selected also in the DCT mode 
switching circuit 55. Moreover, in the case where 
field prodictivo modo (modo whoro data of odd and 
oven fields are separated) is solocted in the predic- 
tive mode switching circuit 52. there is high pos- 
sibility that field DCT mode (mode where data of 
odd and even fields are separated) may be se- 
lected in the DCT mode switching circuit 55. 

However, such a selection is not necessarily 
carried out at all times. In the predictive mode 
switching circuit 52. mode is determined so that 
absolute value sum of predictive errors becomes 
small In the DCT mode switching circuit 55. mode 
is determined so that coding efficiency becomes 

satisfactory- _ 
Picture data of I picture outputted from DOi 
mode switching circuit 55 is inputted to DCT circuit 
56 at which such data is caused to undergo DCT 
(Discrete Cosine Transform) processing so that it is 
transformed into DCT coefficients. These DCT co- 
efficients are inputted to quantizing circuit 57. at 
which they are quantized at quantization step cor- 
responding to data storage quantity (buffer storage 
quantity) of transmit buffer 59. Then. Quantized 
data thus obtained is inputted to variable length 
coding circuit 58. 

Variable length coding circuit 58 converts pic- 
ture data (data of I picture in this case) delivered 
from quantizing circuit 57 into variable length code 
eg Huffman code, etc. in correspondence with 
quantization step (scale) delivered from quantizing 
circuit 57 to output it to transmit buffer 59. 

Variable length coding circuit 58 is supplied 
with quantization step (scale) from quantizing cir- 
cuit 57 predictive mode (mode indicating any one 
of which intra-coding mode, forward predictive 
mode, backward predictive mode or bidirectionally 
predictive mode is set) from predictive judging 
circuit 54. motion vector from motion vector detect- 
ing circuit 50. predictive flag (flag indicating which 
any one of frame predictive mode and field predic- 
tive mode is set) from predictive judging circuit 54. 
DCT flag (flag indicating which any one of frame 
DCT mode and field DCT mode is set) outputted 
from DCT mode switching circuit 55. These in- 
formation are also caused to undergo val.able 

length coding. . 

Transmit buffer 59 temporarily stores data in- 
putted thereto to output data corresponding to a 



quantity of storage to quantizing circuit 57. 

The transmit buffer 59 is operative so that 
when the remaining data quantity increases up to 
allowed upper limit, it allows quantization scale of 
5 • quantizing circuit 57 to be great by quantization 
control signal to thereby lower data quantity of 
quantized data. In contrast, when the remaining 
data quantity decreases down to allowed lower 
limit, transmit buffer 59 allows quantization scale of 
,o quantizing circuit 57 to be small by quantization 
control signal to thereby increase data quantrty of 
quantized data. In this way. overflow or underflow 
of transmit buffer 59 is provontod. 

Data stored in the transmit buffer 59 is read out 
, 5 at a predetermined timing, and is outputted I to 
transmission path through output terminal 69. The 
data thus outputted is recorded onto, e.g., record- 
ing medium 3. . 
On the other hand, data of I picture outputted 
20 from quantizing circuit 57 is inputted to inverse 
quantizing circuit 60. and is inverse-quant.zed in 
correspondence with quantization step delivered 
from quantizing circuit 57. An output of the inverse- 
quantizing circuit 60 is inputted to IDCT (Inverse 
25 DCT) circuit 61. at which it is inverse-DCT pro- 
cessed. Then, the output thus processed is deliv- 
ered to forward predictive, picture section 63a of 
frame memory 63 through operation element 62. 
and is stored thereinto. 
30 Meanwhile, motion vector detecting circuit 50 
is operative so that in the case of respect.vely 
processing picture data of respective frames se- 
quentially inputted as pictures of I, B, P. B, r. t> 
as previously described, for example, after picture 
as data of frame initially inputted is processed as I 
picture, prior to processing, as B picture, picture 
data of frame subsequently inputted, picture data 
of frame further subsequently inputted is processed 
as P picture. This is because since there is the 
ao possibility that B picture may be caused to un- 
dergo backward prediction and bidirectional predic- 
tion, unless P picture as backward predictive pic- 
ture is prepared in advance, it is unable to decode 

,l ' In view of this, motion vector detecting circuit 



45 



ill vio»» * . 

50 initiates processing of picture data of P picture 
stored in backward original picture section 51c 
subsequently to processing of I picture. Similarly to 
the above-described case, evaluation value of intra 
50 coding mode and absolute value sum of interframe 
differences (predictive errors) in macro block units 
are delivered from motion vector detecting circuit 
50 to predictive judging circuit 54. The pred.ctive 
judging circuit 54 sets, in macro block units, any 
55 one of frame predictive mode and field predictive 
mode and any one of intra-coding mode and for- 
ward predictive mode in correspondence with eval- 
uation values of intra coding mode and absolute 
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vatue sum of predictive errors of macro block of 
the P picture. 

Operation section 53 switches switch 53d to 
contact a side as described above when intra- 
coding mode is set. Accordingly, this data is trans- 
mitted to transmission path through DCT mode 
switching circuit 55, DCT circuit 56, quantizing cir- 
cuit 57, variable length coding circuit 58, and trans- 
mit buffer 59 similarly to data of I picture. In 
addition, this data is delivered to backward predic- 
tive picture section 63b of frame memory 63 
through inverse quantizing circuit 60, IDCT circuit 
61, and operation element 62, and is stored 
thereinto. 

On the other hand, at the time of forward 
prediction mode, switch 53d is switched to contact 
b, and picture (picture of I picture in this case) data 
stored in forward predictive picture section 63a of 
frame memory 63 is read out. The data thus read 
out is motion-compensated in correspondence with 
motion vector outputted from motion vector detect- 
ing circuit 50 by motion compensating circuit 64. 
Namely, motion compensating circuit 64 is oper- 
ative so that when setting of forward predictive 
mode is instructed from predictive judging circuit 
54, it reads out data with readout address of for- 
ward predictive picture section 63a being shifted 
by distance corresponding to motion vector from 
the position corresponding to the position of macro 
block that motion vector detecting circuit 50 is 
outputting, thus to generate predictive picture data. 

Predictive picture data outputted from motion 
compensating circuit 64 is delivered to operation 
element 53a. The operation element 53a subtracts, 
from data of macro block of reference picture deliv- 
ered from predictive mode switching circuit 52, 
predictive picture data corresponding to this macro 
block which has been delivered from motion com- 
pensating circuit 64 to output its difference (predic- 
tive error). This difference data is transmitted to 
transmission path through DCT mode switching 
circuit 55, DCT circuit 56, quantizing circuit 57, 
variable length coding circuit 58, and transmit buff- 
er 59. In addition, this difference data is locally 
decoded by inverse quantizing circuit 60, IDCT 
circuit 61. The decoded data thus obtained is input- 
ted to operation element 62. 

This operation element 62 is supplied with the 
same data as predictive picture data delivered to 
operation element 53a. The operation element 62 
adds predictive picture data outputted from motion 
compensating circuit 64 to difference data output- 
ted from IDCT circuit 61. Thus, picture data of 
original (decoded) P picture is obtained. The pic- 
ture data of this P picture is delivered to backward 
predictive picture section 63b of frame memory 63, 
and is stored thereinto. It should be noted that 
since it is necessary from a practical point of view 



that data structure of difference data outputted from 
IDCT circuit and data structure of predictive picture 
data whiph are delivered to operation element 62 
are the same, a circuit for carrying out sequencing 

s of data is required in preparation for the case 
where frame/field predictive mode and frame/field 
DCT mode are different, but indication of such a 
circuit is omitted for brevity. 

Motion vector detecting circuit 50 then ex- 

70 ecutes processing of B picture after data of I pic- 
ture and P picture are respectively stored into 
forward predictive picture section 63a and back- 
ward predictive picture section 63b in a manner 
stated above. Predictive judging circuit 54 sets 

75 framefiield predictive mode in correspondence with 
evaluation value of intra-coding mode and mag- 
nitude of absolute value sum of interframe differ- 
ences, and sets predictive mode to any one of 
intra-coding mode, forward predictive mode, back- 

20 ward predictive mode, and bidirectionally predictive 
mode. 

As described above, when predictive coding 
mode is intra-coding mode or forward predictive 
mode, switch 53d is switched to contact a or con- 
25 tact b. At this time, processing similar to the case 
of p picture is carried out. Thus, data is transmit- 
ted. 

On the contrary, when forward predictive mode 
or bidirectionally predictive mode is set, switch 53d 

30 is switched to either contact c or contact d. 

When predictive coding mode is backward pre- 
dictive mode where switch 53d is switched to con- 
tact c, picture (picture of P picture in this case) 
data which is stored in backward predictive picture 

35 section 63b is read out. The data thus read out is 
motion-compensated in correspondence with mo- 
tion vector outputted from motion vector detecting 
circuit 50 by motion compensating circuit 64. 
Namely, motion compensating circuit 64 is oper- 

40 ative so that when setting of backward predictive 
mode is instructed from predictive judging circuit 
54, it reads out data with readout address of back- 
ward predictive picture section 63b being shifted 
by distance corresponding to motion vector from 

45 position corresponding to position of macro block 
that motion vector detecting circuit 50 is now out- 
putting to generate predictive picture data. 

Predictive picture data outputted from motion 
compensating circuit 64 is delivered to operation 

so element 53b. The operation element 53b subtracts, 
from data of macro block of reference picture deliv- 
ered from predictive mode switching circuit 52, 
predictive picture data delivered from motion com- 
pensating circuit 64 to output difference thereof. 

55 This difference data is transmitted to transmission 
path through DCT mode switching circuit 55, DCT 
circuit 56, quantizing circuit 57, variable length cod- 
ing circuit 58, and transmit buffer 59. 
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When predictive coding mode is bidirectionally 
predictive mode where switch 53d is switched to 
contact d, picture (picture of I picture in this case) 
data stored in forward predictive picture section 
63a and picture (picture of P picture in this case) 
data stored in backward predictive picture section 
63b are read out. These data thus read out are 
motion-compensated in correspondence with mo- 
tion vector outputted from motion vector detecting 
circuit 50 by motion compensating circuit 64. 
Namely, motion compensating circuit 64 is oper- 
ative so that when setting of bidirectionally predic- 
tive mode is instructed from predictive judging 
circuit 54, it reads out data with readout addresses 
of forward predictive picture section 63a and back- 
ward predictive picture section 63b being shifted 
by distances corresponding to motion vectors (at 
this time, two motion vectors for forward predictive 
picture and for backward predictive picture in the 
case of frame predictive mode; and four motion 
vectors in total of two motion vectors for forward 
predictive picture and two motion vectors for back- 
ward predictive picture) from position correspond- 
ing to position of macro block that motion vector 
detecting circuit 50 is now outputting. thus to gen- 
erate predictive picture data. 

Predictive picture data outputted from motion 
compensating circuit 64 is delivered to operation 
element 53c. The operation element 53c subtracts, 
from data of macro block of reference picture deliv- 
ered from motion vector detecting circuit 50, mean 
value of predictive picture data delivered from mo- 
tion compensating circuit 64 to output its differ- 
ence. This difference data is transmitted to trans- 
mission path through DCT mode switching circuit 
55, DCT circuit 56, quantizing circuit 57, variable 
length coding circuit 58, and transmit buffer 59. 

Since there is no possibility that picture of B 
picture is not used as predictive picture of other 
pictures, this picture is not stored into frame mem- 
ory 63. 

It is to be noted that, in frame memory 63, 
forward predictive picture section 63a and back- 
ward predictive picture section 63b are caused to 
undergo bank switching as occasion demands, thus 
making it possible to output, in a switched manner, 
forward predictive picture or backward predictive 
picture stored in one or the other picture section 
with respect to a predetermined reference picture. 

While luminance blocks have been mainly de- 
scribed, color difference blocks are similarly pro- 
cessed with macro block shown in FIGS. 28 and 29 
being as a unit, and is transmitted. It is to be noted 
that, as motion vectors in the case of processing 
color difference blocks, motion vectors obtained by 
allowing motion vectors of corresponding lumi- 
nance blocks to be respectively one half in vertical 
and horizontal directions may be used. 



FIG. 30 is a block diagram showing the con- 
figuration of an example of decoder 31 of FIG. 25. 
Coded picture data transmitted through transmis- 
sion path (recording medium 3) is received by 
5 receiving circuit (not shown), or is reproduced by 
reproducing unit. The data thus obtained is tem- 
porarily stored into receiving buffer 81 through in- 
put terminal 80. Thereafter, such data is delivered 
to variable length decoding circuit 82 of decoding 
w circuit 90. The variable length decoding circuit 82 
allows data delivered from receiving buffer 81 to 
undergo variable length decoding to output motion 
vector, predictive mode, predictive flag and DCT 
flag to motion compensating circuit 87 and to out- 
is put quantization step to inverse quantizing circuit 
83, and to output decoded picture data to inverse 
quantizing circuit 83. 

The inverse quantizing circuit 83 inverse-quan- 
tizes picture data which has been delivered from 
20 variable length decoding circuit 82 in accordance 
with quantization step which has been similarly 
delivered from variable length decoding circuit 82 
to output inverse-quantized data to IDCT circuit 84. 
Data (DCT coefficients) outputted from inverse- 
25 quantizing circuit 83 is caused to undergo inverse- 
DCT processing at IDCT circuit 84. The data thus 
processed is delivered to operation element 85. 

In the case where picture data delivered from 
IDCT circuit 84 is data of I picture, that data is 
30 outputted from operation element 85. This output 
data is delivered to forward predictive picture sec- 
tion 86a of frame memory 86 in order to generate 
predictive picture data of picture data (data of P or 
B picture) inputted later to operation element 85, 
35 and is stored thereinto. In addition, this data is 
outputted to format converting circuit 32 (FIG. 25). 

In the case where picture data delivered from 
IDCT circuit 84 is data of P picture in which picture 
data earlier by one frame is caused to be predic- 
40 tive picture data, and is data of macro block coded 
in forward predictive mode, picture data (data of I 
picture) earlier by one frame, which is stored in 
forward predictive picture section 86a of frame 
memory 86, is read out, and motion compensation 
45 corresponding to motion vector outputted from vari- 
able length decoding circuit 82 is implemented to 
the data thus read out at motion compensating 
circuit 87. At operation element 85, this motion- 
compensated data is added to picture data (data of 
50 difference) delivered from IDCT circuit 84. The 
added data thus obtained is outputted. This added 
data, i.e., decoded data of P picture is delivered to 
backward predictive picture section 86b of frame 
memory 86 in order to generate predictive picture 
55 data of picture data (data of B picture or P picture) 
inputted later to operation element 85. and is 
stored thereinto. 
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Even if corresponding data is data of P picture, 
data of macro block coded in the intra-coding 
mode is not particularly processed at operation 
element 85 similarly to data of I picture, and is 
stored into backward predictive picture section 86b 
as it is. 

Since this P picture is picture to be displayed 
subsequently to B picture, it is not yet outputted to 
format converting circuit 32 at this time point (As 
described above. P picture which has been input- 
ted subsequantly to B picture is processed prior to 
B picture, and is transmitted). 

In tho caso whoro picture data dolivorod from 
IDCT circuit 84 is data of B picture, picture data of 
I picture (in the case of forward predictive mode) 
stored in forward predictive picture section 86a of 
frame memory 86, picture data of P picture (in the 
case of backward predictive mode) stored in back- 
ward predictive picture section 86b, or both picture 
data (in the case of bidirectional ly predictive mode) 
is or are read out in correspondence with predictive 
mode delivered from variable length decoding cir- 
cuit 82. At motion compensating circuit 87, motion 
compensation corresponding to motion vector out- 
putted from variable length decoding circuit 82 is 
implemented to the above-mentioned picture data 
which has been read out. Thus, predictive picture 
is generated. It is to be noted that in the case 
where no motion compensation is required (in the 
case of intra-coding mode), no predictive picture is 
generated. 

Data to which motion compensation has been 
implemented at motion compensating circuit 87 in 
this way is added to an output of IDCT circuit 84 at 
operation element 85. This added output is output- 
ted to format converting circuit 32 through output 
terminal 91 . 

It is to be noted that since this added output is 
data of B picture and is not utilized for generating 
predictive picture of other pictures, it is not stored 
into frame memory 86. 

After picture of B picture is outputted, picture 
data of P picture stored in backward predictive 
picture section 86b is read out, and is outputted as 
reproduction picture through motion compensating 
circuit 87 and operation element 85. It is to be 
noted that motion compensation and addition are 
not carried out at this time. 

It is to be noted that while, in this decoder 31, 
circuits corresponding to predictive mode switching 
circuit 52 and DCT mode switching circuit 55 in 
encoder 18 of FIG. 27 are not illustrated, motion 
compensating circuit 87 executes processing cor- 
responding to these circuits, i.e., processing for 
allowing the configuration in which signals of lines 
of odd field and even field are separated to be 
original configuration in which they are mixed for a 
second time as occasion demands. 
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While processing of luminance signal has been 
described above, processing of color difference 
signal is similarly carried out. It is to be noted that 
motion vector obtained by allowing motion vector 
5 for luminance signal to be one half in vertical and 
horizontal directions may be used. 

While explanation has been made in connec- 
tion with the example of coding and decoding to 
which hierarchical coding is applied, it is known 
io that hierarchical coding is carried out to thereby 
transmit picture of higher resolution and picture of 
lower resolution. In this case, e.g., input picture of 
highor rosolution is causod to undorgo down-sam- 
pling by a circuit as shown in FIG. 31. Namely, 
76 signal of input picture of higher resolution is input- 
ted to low-pass filter 91. at which unnecessary 
higher frequency component is eliminated. The sig- 
nal limited to a predetermined frequency band by 
low-pass filter 91 is inputted to thinning circuit 92, 
20 at which pixels are thinned at a rate of one to two. 
Thus, signal of resolution of 1/4 is obtained. 

The picture signal of resolution of 1/4 is en- 
coded as described above and is transmitted. On 
the other hand, picture signal of higher resolution is 
25 also encoded, and is transmitted along with picture 
signal of resolution of 1/4. In coding the picture 
signal of higher resolution, a predictive picture sig- 
nal of a picture signal of higher resolution is gen- 
erated from a signal obtained by decoding a coded 
30 signal of a picture signal of picture signal of resolu- 
tion of 1/4. For the purpose of generating this 
predictive picture signal, e.g., interpolating circuit 
95 as shown in FIG. 32 is employed. 

A signal obtained by decoding a coded signal 
35 of a picture signal of resolution of 1/4 is inputted to 
this interpolating circuit 95. This interpolating circuit 
95 interpolates this signal as shown in FIG. 33 
(carries out up-sampling). 

Namely, luminance data of line where no lu- 
40 minance data exists is generated by allowing val- 
ues of luminance data positioned at upper and 
lower lines to be respectively one half to add 
(average) them. Since frequency band limitation is 
carried out when down-sampling is carried out by 
45 down-sampling circuit shown in FIG. 31, space 
frequency is not extended by this up-sampling, but 
resolution can be doubled. 

Picture signal of higher resolution is encoded 
on the basis of predictive picture signal generated 
so in this way and is transmitted. 

On the decoder side, picture signal of resolu- 
tion of 1/4 is decoded in a manner similar to the 
above-described case. Moreover, at the time of 
decoding picture signal of resolution of 1/4, a pre- 
ss dictive picture signal of a picture signal of higher 
resolution is generated. Then, the predictive picture 
signal thus generated is used to decode picture 
signal of higher resolution. Also in the case of 
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generating predictive picture signal on the decoder 
side, an interpolating circuit as shown in FIG. 32 is 
used. 

As stated above, in the conventional picture 
signal coding method and decoding method, in the 
case of carrying out hierarchical coding/decoding, a 
picture signal of higher resolution is caused to 
undergo down-sampling at a rate of 2:1 to generate 
a picture signal of lower resolution. As a result, 
when high definition television signal represented 
by, e.g., high vision is employed as picture signal 
of high resolution, in the case of coding picture 
signal of low resolution obtained by allowing such 
picture signal of higher resolution to undergo down- 
sampling at a rate of 2:1 to transmit it, its aspect 
ratio remains to be 16:9. Accordingly, in television 
image receiver of the NTSC system having aspect 
ratio of 4:3, it was disadvantageously unable to 
monitor picture signal of resolution of 1/4. 

Disclosure of the Invention 

This invention has been made in view of such 
circumstances, and contemplates permitting picture 
signal of lower resolution obtained by allowing pic- 
ture signal of higher resolution having aspect ratio 
of 16:9 to undergo down-sampling to be monitored 
on conventional image receiver of the NTSC sys- 
tem, for example. 

A picture signal coding method according to 
this invention is directed to a picture signal coding 
method comprising the steps of decomposing a 
picture signal into a picture signal of lower resolu- 
tion and a picture signal of higher resolution, gen- 
erating a predictive picture signal of a picture sig- 
nal of higher resolution from a signal obtained by 
decoding a coded signal of a picture signal of 
lower resolution, and encoding a picture signal of 
higher resolution by using the generated predictive 
picture signal, characterized in that the method 
comprises the steps of implementing thinning to a 
picture signal of higher resolution by using spatial 
filtering at a predetermined resolution so as to have 
an aspect ratio between the numbers of pixels in 
longitudinal and lateral directions different from 
each other to generate a picture signal of lower 
resolution; implementing a predetermined process- 
ing to a signal obtained by decoding a coded 
signal of a picture signal of lower resolution by 
using spatial filtering at a predetermined resolution 
so as to have the original aspect ratio to generate a 
predictive picture signal of a picture signal of high- 
er resolution; and encoding the picture signal of 
higher resolution by using the generated predictive 
picture signal. 

The numbers of pixels in longitudinal and lat- 
eral directions of a picture signal of higher resolu- 
tion are caused to be respectively 1/2 times and 



3/8 times, thereby making it possible to convert the 
higher resolution picture signal into a picture signal 
of lower resolution of the squeeze system. At this 
time, the numbers of pixels in longitudinal and 
5 lateral directions of a signal obtained by decoding 
a coded signal of a picture signal of lower resolu- 
tion are caused to be respectively 2 times and 8/3 
times, thus making it possible to generate a predic- 
tive picture signal of higher resolution. This method 
10 can be applied to, e.g., a picture signal of higher 
resolution in which the number of pixels in lateral 
direction is 1920 and the number of pixels in lon- 
gitudinal direction is 960, or a picture signal of 
higher resolution in which the number of pixels in 
is lateral direction is 1920, and the number of pixels 
in longitudinal direction is 1152. 

Moreover, the numbers of pixels in longitudinal 
and lateral directions of a picture signal of higher 
resolution are permitted to be respectively 7/15 
20 times and 3/8 times. This method can be applied to 
a picture signal of higher resolution in which the 
number of pixels in lateral direction is 1920 and the 
number of pixels in longitudinal direction is 1024. 
Another picture signal coding method accord- 
25 ing to this invention is directed to a picture signal 
coding method comprising the steps of decompos- 
ing a picture signal into a picture signal of lower 
resolution and a picture signal of higher resolution, 
generating a predictive picture signal of the picture 
30 signal of higher resolution from a signal obtained 
by decoding a signal of a coded signal of the 
picture signal of lower resolution, and encoding the 
picture signal of higher resolution by using the 
generated predictive picture signal, characterized in 
35 that the method comprises the steps of implement- 
ing thinning processing to a picture signal of higher 
resolution by using spatial filtering at a resolution of 
3/8 times in longitudinal direction and 3/8 times in 
lateral direction to generate a picture signal of 
40 lower resolution of the letter box system; imple- 
menting a predetermined processing to a signal 
obtained by decoding a coded-signal of the picture 
signal of lower resolution by using spatial filtering 
at a resolution of 8/3 times in longitudinal direction 
45 and 8/3 times in lateral direction to generate a 
predictive picture signal of the picture signal of 
higher resolution; and encoding the picture signal 
of higher resolution by using the generated predic- 
tive picture signal, 
so This method can be applied to a picture signal 

of higher resolution in which the number of pixels 
in lateral direction is 1920 and the number of pixels 
in longitudinal direction is 960, or a picture signal in 
which the number of pixels in lateral direction is 
55 1920 and the number of pixels in longitudinal direc- 
tion is 1152. 

Moreover, there may be employed a method 
comprising the steps of implementing thinning pro- 
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cessing to a picture signal of higher resolution so 
that pixels in vertical and lateral directions are 
respectively 7/20 times and 3/8 times to generate a 
picture signal of lower resolution of the letter box 
system, and implementing a predetermined pro- 
cessing to a signal obtained by decoding a coded 
signal of the picture signal of lower resolution by 
using spatial filtering at a resolution of 20/7 times in 
longitudinal direction and 8/3 times in lateral direc- 
tion, thus making it possible to generate a predic- 
tive picture signal of a picture signal of higher 
resolution. This method can be applied to a picture 
signal of higher resolution in which the number of 
pixels in lateral direction is 1920 and the number of 
pixels in longitudinal direction is 1024. 

Further, the numbers of pixels in longitudinal 
and lateral directions of a picture signal of higher 
resolution are permitted to be respectively 1/3 
times and 3/8 times. 

Picture signal decoding methods correspond- 
ing to these picture signal coding methods can be 
realized. In addition, by applying these methods, it 
is possible to realize a coding apparatus and a 
decoding apparatus. 

In the picture signal coding method according 
to this invention, picture signal of lower resolution 
is generated from picture signal of higher resolution 
so that different aspect ratio is provided. Accord- 
ingly, it is possible to generate, e.g., picture signal 
of lower resolution having aspect ratio of 4:3 from 
picture signal of higher resolution having aspect 
ratio of 16:9. As a result, it is possible to convert, 
e.g., picture signal of high vision into picture signal 
of lower resolution to transmit the picture signal of 
lower resolution to monitor it by image receiver of 
the NTSC system. 

Brief Description of the Drawings 

FIG. 1 is a block diagram showing the configu- 
ration of an embodiment of a picture signal coding 
apparatus according to this invention. 

FIG. 2 is a block diagram showing an example 
of the configuration of down-sampling circuit 301 of 
FIG. 1. 

FIG. 3 is a block diagram showing an example 
of the configuration of up-sampling circuit 302 of 
FIG. 1. 

FIG. 4 is a block diagram showing the configu- 
ration of an embodiment of a picture signal decod- 
ing apparatus according to this invention. 

FIG. 5 is a view for explaining an example of 
first processing in the down-sampling circuit 301 of 
FIG. 1. 

FIG. 6 is a view for explaining down-sampling 
in lateral direction in the embodiment of FIG. 5. 

FIG. 7 is a view for explaining down-sampling 
in longitudinal direction in the embodiment of FIG. 



5. 

FIG. 8 is a view for explaining processing of 
up-samp[jng corresponding to the down-sampling 
of FIG. 6* 

5 FIG. 9 is a view for explaining processing of 

up-sampling corresponding to the down-sampling 
of FIG. 7. 

FIG. 10 is a view for explaining an example of 
a second processing in the down-sampling circuit 
w 301 of FIG. 1 . 

FIG. 11 is a view for explaining down-sampling 
in longitudinal direction of the embodiment of FIG. 
10. 

FIG. 12 is a view for explaining processing of 
75 up-sampling corresponding to the down-sampling 
of FIG. 11. 

FIG. 13 is a view for explaining an example of 
a third processing in the down-sampling circuit 301 
of FIG. 1. 

20 FIG. 14 is a view for explaining the down- 

sampling in longitudinal direction of the embodi- 
ment of FIG. 13. 

FIG. 15 is a view for explaining up-sampling 
corresponding to the down-sampling of FIG. 14. 

25 FIG. 16 is a view for explaining an example of 

a fourth processing in the down-sampling circuit 
301 of FIG. 1. 

FIG. 17 is a view for explaining down-sampling 
in longitudinal direction of the embodiment of FIG. 

30 16. 

FIG. 18 is a view for explaining up-sampling 
corresponding to the down-sampling of FIG. 17. 

FIG. 19 is a view for explaining another exam- 
ple of processing of down-sampling in longitudinal 
35 direction of the embodiment of FIG. 16. 

FIG. 20 is a view for explaining up-sampling 
corresponding to the down-sampling of FIG. 19. 

Fig. 21 is a view for explaining a method of 
manufacturing a disc on which data coded by pic- 
40 ture signal coding method according to this inven- 
tion is recorded. 

FIG. 22 is a view for explaining the principle of 
efficient coding. 

FIG. 23 is a view for explaining picture type for 
45 encoding picture. 

FIG. 24 is a view for explaining the principle for 
encoding successive moving picture signals. 

FIG. 25 is a block diagram showing the con- 
figuration of conventional moving picture cod- 
so ing/decoding apparatuses. 

FIG. 26 is a view for explaining structure of 
picture data. 

FIG. 27 is a block diagram showing an exam- 
ple of the configuration of encoder 18 of FIG. 25. 
55 FIG. 28 is a view for explaining the operation of 

predictive mode switching circuit 52 of FIG. 27. 

FIG. 29 is a view for explaining the operation of 
DCT mode switching circuit 55 of FIG. 27. 
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FIG. 30 is a block diagram showing an exam- 
pie of the configuration of decoder 31 of FIG. 25. 

FIG. 31 is a block diagram showing an exam- 
ple of the configuration of conventional down-sam- 
pling circuit. 

FIG. 32 is a block diagram showing an exam- 
ple of the configuration of conventional up-sam- 
pling circuit. 

FIG. 33 is a view for explaining the operation of 
interpolating circuit 95 of FIG. 32. 

Bost Mode for Carrying Out the Invention 

FIG. 1 is a block diagram showing the configu- 
ration of an embodiment of a picture signal coding 
apparatus (encoder) of this invention. In this em- 
bodiment, hierarchical coding is carried out. In the 
figure, blocks indicated by reference numerals in a 
range from more than 100 to less than 200 are 
blocks for carrying out processing of picture signal 
of lower resolution, and blocks indicated by refer- 
ence numerals in a range from more than 200 to 
less than 300 are blocks for processing picture 
signal of higher resolution. Respective blocks for 
carrying out processing of hierarchies basically 
have a configuration similar to the encoder shown 
in FIG. 27. In FIG. 1, the lower order two digits of 
reference numerals in the range from more than 
100 to less than 200 and in the range from more 
than 200 to less than 300 are caused to be in 
correspondence with reference numerals of two 
digits of corresponding functional blocks in FIG. 27. 

It is to be noted that while, in FIG. 1, indication 
of predictive mode switching circuit 52 and DCT 
mode switching circuit 55 in FIG. 27 is omitted for 
brevity, corresponding circuits are inserted also in 
the embodiment of FIG. 1. In addition, predictive 
judging circuit 54 in FIG. 27 is not illustrated in 
FIG. 1 for brevity, but operation section 153 in FIG. 
1 is assumed to include this predictive judging 
circuit 54 as well. 

As input picture, higher resolution picture 201 
is prepared. This higher resolution picture is con- 
verted into 1/4 resolution picture 101 through 
down-sampling circuit 301 for hierarchical coding. 
Down-sampling circuit 301 is composed, as shown 
in FIG. 2, of low-pass filter 901 for band limitation 
and thinning circuit 902 for thinning data. The detail 
of the operation of this down-sampling circuit 301 
will now be described later. 

Since processing of 1/4 resolution picture 101 
is basically similar to that in the case shown in^FIG. 
27, it will be briefly described. 1/4 resolution* pic- 
ture 101 is inputted to motion vector detecting 
circuit 150. When such picture is inputted, motion 
vectors thereof are detected between reference 
original picture and forward original picture or back- 
ward original picture, or between reference original 



picture and forward original picture and between 
reference original picture and backward original 
picture which are read out as occasion demands in 
macro block units from frame memory 151 in ac- 
5 cordance with picture sequence (sequence for pro- 
cessing I picture, P picture or B picture, etc.) set in 
advance. 

Operation section 153 determines predictive 
mode of reference block on tho basis of absolute 
io value sum of interframe differences in block units 
calculated at motion vector detecting circuit 150. 
Moreover, prodictivo modo determined at operation 
soction 153 is dolivorod to Variable Longth Coding 
circuit (VLC) 158. 
75 The operation section 153 carries out, on the 

basis of this predictive mode, switching of intra- 
coding mode, forward predictive mode, backward 
predictive mode or bidirectionally predictive mode 
in block units to generate input picture itself in the 
20 case of intra-coding mode, and to generate inter- 
frame coded data (difference data) from each cor- 
responding predictive picture in the case of the 
forward, backward or bidirectionally predictive 
mode, thus to deliver this difference data to DCT 
25 circuit 156 through operation section 153. 

This DCT circuit 156 implements Discrete Co- 
sine Transform processing to input picture data or 
difference data in block units by making use of the 
two-dimensional correlation of picture signal to out- 
30 put DCT processed data obtained as the result 
thereof to quantizing circuit (Q) 157. 

The quantizing circuit 157 quantizes DCT pro- 
cessed data at quantization step size determined 
every macroblock and slice to deliver quantized 
35 data obtained on the output terminal as the result 
thereof to Variable Length Coding (VLC) circuit 158 
and Inverse Quantizing circuit (IQ) 160. Quantiza- 
tion scale used for quantization is determined so 
that it becomes equal to a value such that transmit 
40 buffer memory 159 does not break down by carry- 
ing out feedback of buffer memory residual of 
transmit buffer memory 159. This quantization 
scale is also delivered from quantizing circuit 157 
to variable length coding circuit 158 and inverse 
45 quantizing circuit 160 along with quantized data. 

In this case. VLC circuit 158 implements vari- 
able length coding processing to quantized data 
along with quantization scale, macro block type 
(predictive mode), and motion vector to deliver the 
so data thus processed to transmit buffer memory 159 
as transmit data. 

Finally, bit stream 109 of 1/4 resolution picture 
is transmitted in order of (predictive mode), (motion 
vector), (DCT coefficient). 
55 Inverse quantizing circuit 160 inverse-quantizes 

quantized data sent from quantizing circuit 157 so 
as to take a representative value to thereby convert 
it into inverse-quantized data to deliver the inverse- 
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quantized data to Inverse Discrete Cosine Trans- 
form (IDCT) circuit 161. The IDCT circuit 161 trans- 
forms inverse quantized data decoded at inverse- 
quantizing circuit 160 into decoded picture data by 
transform processing complementary to that of 
DCT circuit 156 to output it to frame memory 163 
through operation element 1 62. 

Motion Compensation circuit (MC) 164 imple- 
ments motion compensating processing to data 
stored in frame memory 1 63 on the basis of macro 
block type, motion vector, Frame/Field predictive 
Flag, Frame/Field DCT Flag, thus to generate a 
predictive picture signal. The operation element 
162 adds this predictive picture signal and output 
data (difference data) of IDCT circuit 161 to carry 
out local decoding. The decoded picture is written 
into frame memory 163 as forward predictive pic- 
ture or backward predictive picture. 

At frame memory 163, bank switching is car- 
ried out as occasion demands. Thus, single frame 
is outputted as backward predictive picture, or is 
outputted as forward predictive picture in depen- 
dency upon picture to be coded. In the case of 
forward, backward or bidirectional prediction, since 
difference from predictive picture is sent as output 
of IDCT circuit 161, this difference is added, at 
operation element 162, to predictive picture output- 
ted from motion compensating circuit 164, thus to 
carry out local decoding. This predictive picture is 
entirely the same picture as picture decoded at 
decoder, and forward, backward or bidirectional 
prediction is implemented to picture to be subse- 
quently processed on the basis of the predictive 
picture. 

While coding procedure of 1/4 resolution pic- 
ture has been described as above, output of the 
operation element 162 is delivered to up-sampling 
circuit 302 on the encoder side of high resolution 
picture as spatial predictive picture signal of high 
resolution picture signal, and it is utilized for pre- 
diction. 

Coding procedure of higher resolution picture 
201 will now be described. This coding procedure 
is entirely the same as coding procedure of 1/4 
resolution picture except for procedure for generat- 
ing predictive picture signal. 

Higher resolution picture 201 is delivered to 
operation section 253 through motion vector de- 
tecting circuit 250. This operation section 253 car- 
ries out, along with intra coding, forward, backward 
or bidirectional prediction by motion compensation 
from frame memory 263, or prediction from 1/4 
resolution picture. At coding of 1/4 resolution pic- 
ture, picture data outputted from operation element 
162 is interpolation-processed by upsampling cir- 
cuit 302 so as to have resolution similar to high 
resolution picture. Typical up-sampling circuit 302 
is constituted by interpolating circuit 903, as shown 



in FIG. 3, for example. The detail of its operation 
will be described later. 

Interpolation picture generated by up-sampling 
circuit 302 is inputted to weighting circuit 303. At 

5 this weighting circuit 303, output of up-sampling 
circuit 302 is multilied by weight (1-W). This is 
assumed to be first predictive picture signal. 

On the other hand, temporal predictive picture 
is outputted in correspondence with forward, back- 

io ward or bidirectional motion compensation from 
motion compensating circuit 264. This predictive 
picture is multiplied by weight W by weighting 
circuit 306. This is assumed to be second predic- 
tive picture signal. 

is The above-mentioned first and second predic- 

tive picture signals are added at adder 304 or 305. 
Thus, third predictive picture signal is generated. 
By making use of the third predictive picture signal, 
prediction is carried out at operation section 253. 

20 Weight W is determined at weight judging cir- 

cuit 307 so that predictive efficiency of the third 
predictive picture signal becomes the highest. At 
the same time, this weight W is delivered to vari- 
able length coding circuit (VLC) 258. at which it is 

25 coded. Thus, coded weight data is transmitted. 

Operation section 253 uses 1/4 resolution pic- 
ture as spatial predictive picture in addition to the 
conventional motion compensation in a manner 
stated above, thereby making it possible to obtain 

30 higher prediction efficiency. At this section, predic- 
tive mode is determined. 

The determined predictive mode is delivered to 
variable length coding circuit 258, at which it is 
coded. Thus, coded predictive mode data is trans- 

35 mitted. Moreover, the predictive data mentioned 
above is delivered to DCT circuit 256. Other pro- 
cessing are the same as coding of 1/4 resolution 
picture. 

Finally, bit stream 209 of high resolution pic- 

40 ture is transmitted in order of (predictive mode), 
(motion vector), (weight W) and <DCT coefficient). 

Procedure for decoding data which has been 
hierarchically-coded and has been transmitted in 
this way will now be described. 

45 Block diagram of decoder of hierarchically-cod- 

ed data is shown in FIG. 4. In this figure, reference 
numerals in a range from more than 400 to less 
than 500 represent blocks for decoding picture 
signal of 1/4 resolution, and reference numerals in 

so a range from more than 500 to less than 600 
represent blocks for decoding picture signal of 
higher resolution. The fundamental operations of 
respective blocks are similar to that in the case 
shown in FIG. 30, and reference numerals of the 

55 lower order two digits of respective blocks are 
caused to be in correspondence with reference 
numerals of two digits of corresponding blocks of 
FIG. 30. 
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Bit stream 401 of 1/4 resolution (corresponding 
to output 109 of transmit buffer 159 of FIG. 1) is 
decoded in the same manner as in the prior art. 1/4 
resolution bit stream 401 is inputted through trans- 
mit medium (e.g., recording medium 3 of FIG. 25). 
This bit stream is inputted to variable length decod- 
ing (Inverse Variable Length Coding) (IVLC) circuit 
482 through receiving buffer 481. The variable 
length decoding circuit (IVLC) 482 decodes, from 
bit stream, quantized data, motion vector, macro 
block type, quantization scale, Frame/Held predic- 
tion Flag, and Frame/Field DCT Flag. The quan- 
tized data and the quantization scale are inputted 
to the next inverse quantizing circuit (IQ) 483. 

The operations of inverse quantizing circuit 
483, IDCT circuit 484, operation element 485, 
frame memory 486, and motion compensating cir- 
cuit 487 are similar to those in the case described 
in the explanation of decoder of FIG. 30. Aa a 
processed output of these circuits, 1/4 resolution 
picture 408 is obtained. At the same time, decoded 
picture is stored into frame memory 486 for the 
purpose of prediction of the next picture. 

On the other hand, picture stored in this frame 
memory 486 is inputted to up-sampling circuit 602 
of high resolution decoding apparatus as spatial 
predictive picture signal used for decoding of high- 
er resolution picture. This up-sampling circuit 602 
is comprised of interpolating circuit 903, as shown 
in FIG. 3, similarly to the up-sampling circuit 302 of 
FIG. 1. Data caused to undergo up-sampling by the 
up-sampling circuit 302 is delivered to weighting 
circuit 603, at which it is multiplied by weight of (1- 
W). This is assumed to be first predictive picture 
with respect to high resolution decoding apparatus. 

At the high resolution decoding apparatus, de- 
coding is carried out after undergone entirely the 
same processing as 1/4 resolution picture signal. 
Namely, high resolution bit stream 501 is inputted 
through transmit media. This bit stream is inputted 
to variable length decoding (Inverse Variable 
Length coding) (IVLC) circuit 582 through receiving 
buffer 581 , at which it is decoded. 

The variable length decoded data is processed 
by inverse quantizing circuit (IQ) 583, IDCT circuit 
584, operation element 585, frame memory 586, 
and motion compensating circuit 587. Output from 
the motion compensating circuit 587 is inputted to 
weighting circuit 604, and is multiplied by weigh- 
ting coefficient W thereat. Thus, second predictive 
picture signal is formed. 

This second predictive picture signal and the 
above-mentioned first predictive picture signal ^rom 
the 1/4 resolution picture are added at adder 605, 
resulting in third predictive picture signal for high 
resolution decoding apparatus. The third predictive 
picture signal is added, at operation element 585, 
to difference data outputted from IDCT circuit 584. 



Thus, original picture of higher resolution picture is 
decoded. This higher resolution picture 508 is 
stored into frame memory 586 for the purpose of 
prediction of the next picture at the same time. 
5 Here, weight utilized is weight W used in the 

weighting circuit 306 of FIG. 1. This weight is 
obtained from IVLC circuit 582 via decoder of bit 
stream 209 (501). 

In a manner stated above, decoding of higher 
10 resolution picture is carried out. 

FIG. 5 shows an example of the relationship 
between resolution of higher resolution picture and 
that of lower resolution picture. Namely, in this 
example, higher resolution picture 201 of FIG. 1 
75 has resolution of H pixels in lateral direction and V 
pixels in longitudinal (vertical) direction. This higher 
resolution picture 201 is converted into lower reso- 
lution picture 101 having resolution of H x 3/8 
pixels in lateral direction and V x 1/2 pixels in 
20 longitudinal direction by down-sampling circuit 301. 
This lower resolution picture is picture of format of 
the so-called squeeze system (picture becomes 
long in longitudinal direction). 

Such a down-sampling is realized by down- 
25 sampling circuit of a structure shown in FIG. 2. 
Namely, input signal is band-limited by low-pass 
filter 901. and is then inputted to thinning circuit 
902. Thus, such input signal is thinned so that 
pixels in lateral and longitudinal directions respec- 
30 tively become equal to 3/8 pixels in lateral direction 
and 1/2 pixels in longitudinal direction. 

FIG. 6 shows the principle of thinning in lateral 
direction of down-sampling circuit 301 (thinning cir- 
cuit 902). As an example for the purpose of carry- 
35 ing out thinning in a simple manner, coefficients (1 , 
1/3, 2/3) shown in FIG. 6 are represented by using 
inverse numbers of ratios between distances of 
adjacent input pixels corresponding to output pixel 
positions. Values obtained by multiplying pixel val- 
40 ues of adjacent pixels by these coefficients to add 
them provide values of output pixels. It should be 
noted that when position of input pixel and position 
of output pixel are equal to each other, value of 
input pixel provides a value of output pixel as it is. 
45 Namely, input pixel a of eight input pixels a to 

h is outputted as output pixel A as it is. Value 
obtained by multiplying input pixel c by 1/3 and 
value obtained by multiplying input pixel d by 2/3 
are added. Thus, output pixel B is generated. 
50 Moreover, value obtained by multiplying input pixel 
f by 1/3 and value obtained by multiplying input 
pixel g by 2/3 are added. Thus, output pixel C is 
generated. In this way, three output pixels are 
interpolated from eight input pixels. 
55 FIG. 7 shows the principle of thinning in lon- 

gitudinal direction of down-sampling circuit 301 
(thinning circuit 902). By taking into consideration 
the interlace structure of picture, thinning is carried 
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out so that the number of pixels in longitudinal 
directions becomes equal to one half thereof. As an 
example for the purpose of carrying out thinning in 
a simple manner, coefficients (1, 1/2) shown in FIG. 
7 are represented by using inverse numbers of 
ratios between distances of adjacent input pixels 
corresponding to output pixel positions. Values ob- 
tained by multiplying pixel values of adjacent pixel 
by these coefficients to add them provide values of 
output pixels. It should be noted that when position 
of input pixel and position of output pixel are equal 
to oach othor, valuo of input pixel provides a valuo 
of output pixel as it is. 

Namely, in the first field F1, lines are thinned 
every other line. In the second field F2, input pixels 
a and b, c and d, e and f, etc. of lines adjacent in 
upper and lower directions are multiplied by coeffi- 
cients of 1/2 and respective multiplied values thus 
obtained are added. Thus, output pixels A, B, C, 
etc. are constructed (generated). 

In this way, lower resolution picture of 3/8 
times in lateral direction and 1/2 times in longitudi- 
nal direction shown in FIG. 5 is obtained. 

When down-sampling circuit 301 of FIG. 1 op- 
erates in a manner stated above, interpolating cir- 
cuit 903 of FIG. 3 constituting up-sampling circuits 
302 and 602 of FIGS. 1 and 4 interpolates data so 
as to have resolution of 8/3 times in lateral direc- 
tion and 2 times in longitudinal direction. 

FIG. 8 shows the principle of interpolation of 
8/3 times in lateral direction. As an example for the 
purpose of carrying out simple interpolation, coeffi- 
cients (1, 7/8, 6/8, 5/8. 4/8, 3/8, 2/8. 1/8) shown in 
FIG. 8 are represented by using inverse numbers 
of distances of adjacent input pixels corresponding 
to output pixel positions. Values obtained by mul- 
tiplying pixel values of adjacent pixels by the above 
coefficients to add them provide values of output 
pixels. It should be noted that when position of 
input pixel and position of output pixel are equal to 
each other, value of input pixel provides a value of 
output pixel as it is. 

Namely, input pixel a is caused to be output 
pixel A as it is. Value obtained by multiplying input 
pixel a by coefficient 5/8 and value obtained by 
multiplying input pixel b by 3/8 are added, resulting 
in output pixel B. Output pixels succeeding thereto 
are similarly interpolated. 

FIG. 9 shows the principle of interpolation of 
two times in longitudinal direction. By taking into 
consideration interlace structure of picture, inter- 
polation of two times is carried out in longitudinal 
direction. As an example for the purpose of carry- 
ing out simple interpolation, coefficients (1, 3/4, 1/2, 
1/4) shown in FIG. 9 are represented by using 
inverse numbers of distances of adjacent input 
pixels corresponding to output pixel positions. Val- 
ues obtained by multiplying pixel values of adja- 



cent pixels by these coefficients to add them pro- 
vides values of output pixels. It should be noted 
that when position of input pixel and position of 
output pixel are equal to each other, value of input 

5 pixel provides a value of output pixel as it is. 

Namely, in the first field F1, input pixels a, b. c, 
etc. are caused to be respectively output pixels A, 
C, E, etc. as they are, and, e.g., output pixel D 
therebetween is generated by multiplying input pix- 

io els b and c by 1/2 to add them. In the second field 
F2, e.g., value obtained by multiplying input pixel b 
by 3/4 and valuo obtainod by multiplying input 
pixel c by 1/4 aro added. Thus, output pixol D is 
generated. 

is In the embodiment shown in FIG. 5, higher 

resolution pixel having 1920 pixels in lateral direc- 
tion and 960 pixels in longitudinal direction can be 
converted into lower resolution picture having 720 
pixels in lateral direction and 480 pixels in longitu- 

20 dinal direction, and higher resolution picture having 
1920 pixels in lateral direction and 1152 pixels in 
longitudinal direction can be converted into lower 
resolution picture having 720 pixels in lateral direc- 
tion and 576 pixels in longitudinal direction. 

25 Thus, e.g., picture of the high-vision system of 

aspect ratio of 1 6:9 is caused to have lower resolu- 
tion, thus making it possible to monitor such pic- 
ture on an image receiver of the NTSC system of 
aspect ratio of 4:3. 

30 FIG. 10 shows another example of the relation- 

ship between resolutions of higher resolution pic- 
ture and lower resolution picture. In this example, 
higher resolution picture has resolution of H pixels 
in lateral direction and V pixels in longitudinal di- 

35 rection, and lower resolution picture has resolution 
of H x 3/8 pixels in lateral direction and Vx7/15 
pixels in longitudinal direction. This lower resolution 
picture also has picture of the squeeze system. 
In the case of this embodiment, it is required to 

40 allow ratios of thinning in lateral and longitudinal 
directions to be respectively 3/8 and 7/15. Down- 
sampling of 3/8 times in lateral direction can be 
realized by the principle shown in FIG. 6. 

FIG. 11 shows the principle for thinning pixels 

45 in longitudinal direction so that its number is equal 
to 7/15. Also in this case, by carrying out weighting 
as indicated by the following formula by inverse 
number of ratio between distances a and b with 
respect to input pixels x, y, output pixel z can be 

so obtained. 

z = x(b/(a + b)) + y(a/(a + b)) 

Thus, seven output pixels are interpolated from 
55 fifteen input pixels. 

Moreover, in the case of this embodiment, in 
the up-sampling, it is required to allow ratios of 
thinning in lateral and longitudinal directions to be 
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respectively 8/3 arid 15/7. Interpolation of 8/3 times 
in lateral direction can be realized by the principle 
shown in FIG. 8. 

Up-sampling of 15/7 times in longitudinal direc- 
tion can be realized on the basis of the principle as 
shown in FIG. 12. Namely, also in this case, by 
carrying out weighting as indicated by the following 
formula by inverse number of ratio between dis- 
tances a and b corresponding to input pixels x, y, 
output pixel z can be obtained. 

z = x(b/(a + b)) + y(a/(a + b)) 

It is sufficient to generate fifteen output pixels 
from seven input pixels on the basis of the above- 
mentioned principle. 

Embodiment of FIG. 10 can be applied to the 
case where higher resolution picture having 1920 
pixels in lateral direction and 1024 pixels in longitu- 
dinal direction is converted into lower resolution 
picture having 720 pixels in lateral direction and 
483 pixels in longitudinal direction. When down- 
sampling of 7/15 times is implemented, in longitu- 
dinal direction, to 1024 pixels in longitudinal direc- 
tion, the number of pixels obtained is less than 483 
pixels. In this case, such a processing is carried 
out to add several lines of non-picture to upper and 
lower end portions of picture, etc. 

FIG. 13 shows a still further embodiment. In 
this embodiment, picture of higher resolution of H 
pixels in lateral direction and V pixels in longitudi- 
nal direction is converted into lower resolution pic- 
ture having resolution of H x 3/8 pixels in lateral 
direction and Vx3/8 pixels in longitudinal direction. 
This lower resolution picture is caused to be pic- 
ture of format of the letter box system (pixels are 
not distorted, but it is necessary to carry out dis- 
play with non-picture data being inserted at upper 
and lower portions). 

Namely, in this embodiment, since picture of 
higher resolution is caused to undergo down-sam- 
pling at the same ratio in lateral and longitudinal 
directions, picture of lower resolution has the same 
aspect ratio as that of picture of higher resolution. 
For example, in image receiver of the NTSC sys- 
tem, this lower resolution picture is processed as 
picture of the letter box system. Namely, picture is 
displayed with a necessary number of lines (non- 
picture) being added to upper and lower portions of 
picture transmitted. 

Down-sampling of 3/8 times in lateral direction 
can be realized in accordance with the principle 
shown in FIG. 6. Moreover, down-sampling of 3/8 
times in longitudinal direction can be realized in 
accordance with the principle shown in FIG. 14, for 
example. 

Namely, in this embodiment, in the first field 
F1 , input pixel a is outputted as output pixel A as it 



is. Value obtained by multiplying input pixel c by 
1/3 and value obtained by multiplying input pixel d 
by 2/3 are added, thus to generate output pixel B. 
Further, value obtained by multiplying input pixel f 
5 by 1/3 and value obtained by multiplying input 
pixel g by 2/3 are added, thus to generate output 
pixel C. 

On the other hand, in the second field F2, 
value obtained by multiplying input pixel a by 1/6 
w and value obtained by multiplying input pixel b by 
5/6 are added. Thus, output pixel A is generated. 
Moreover, value obtained by multiplying input pixel 
d by 1/2 and value obtained by multiplying input 
pixel e by 1/2 are added. Thus, output pixel B is 
75 generated. Further, value obtained by multiplying 
input pixel g by 5/6 and value obtained by multiply- 
ing input pixel h by 1/6 are added, thus to generate 
output pixel C. In a manner stated above, data of 
three lines are generated from data of eight lines. 
20 Up-sampling of 8/3 times in lateral direction 

can be realized in accordance with the principle 
shown in FIG. 8 as described above. 

Up-sampling of 8/3 times in longitudinal direc- 
tion can be realized in accordance with the princi- 
25 pie shown in FIG. 15. Namely, in the first field F1, 
input pixel a is caused to be output pixel A as it is. 
Output pixel B is generated by adding value ob- 
tained by multiplying input pixel a by 5/8 and value 
obtained by multiplying input pixel b by 3/8. Fur- 
30 ther, output pixel C is generated by adding value 
obtained by multiplying input pixel a by 2/8 and 
value obtained by multiplying input pixel b by 6/8. 
Also with respect to data subsequent thereto, simi- 
larly to the above, data of output pixels are gen- 
35 erated by multiplying adjacent input pixels by co- 
efficients shown to add them. 

Also in the second field F2, similarly to the 
above, output pixels are generated by multiplying 
input pixels by predetermined coefficients. In this 
40 way, data of eight lines are generated from data of 
three lines. 

Embodiment shown in FIG. 13 can be applied 
to, e.g., the case where down-sampling is carried 
out so that higher resolution picture of 1920 pixels 

45 in lateral direction and 960 pixels in longitudinal 
direction is converted into lower resolution picture 
of 720 pixels in lateral direction and 360 pixels in 
longitudinal direction, or the case where down- 
sampling is carried out so that higher resolution 

so picture of 1920 pixels in lateral direction and 1152 
pixels in longitudinal direction is converted into 
lower resolution picture of 720 pixels in lateral 
direction and 432 pixels in longitudinal direction. 
FIG. 16 shows a still more further embodiment. 

55 In this embodiment, higher resolution picture of H 
pixels in lateral direction and V pixels in longitudi- 
nal direction is converted into lower resolution pic- 
ture of H x 3/8 pixels in lateral direction and V x 
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7/20 pixels in longitudinal direction. This lower res- 
olution picture is caused to be picture of format of 
the letter box system. 

Down-sampling of 3/8 times in lateral direction 
can be realized in accordance with the principle 
shown in FIG. 6. 

Down-sampling of 7/20 times in longitudinal 
direction can be realized in accordance with the 
principle shown in FIG. 17, for example. Also in this 
case, output pixel z can be obtained by calculating 
the following formula in correspondence with dis- 
tances a and b with respect to input pixels x and y. 

z = x(b/(a + b)) + y(a/(a + b)) 

By this calculation, in the first and second 
fields F1 and F2, it is sufficient to generate data of 
seven tines from 20 lines, respectively. 

Up-sampling of 8/3 times in lateral direction 
can be realized in accordance with the principle 
shown in FIG. 8. 

Up-sampling of 20/7 times in longitudinal direc- 
tion can be realized in accordance with the princi- 
ple shown in FIG. 18, for example. Also in this 
case, in the first and second fields F1 and F2, 
calculation by the following formula is carried out in 
correspondence with distances a and b with re- 
spect to input pixels x and y, thus making it possi- 
ble to obtain output pixel z. 

z = x(b/(a + b)) + y(a/(a + b)) 

In this way, in respective fields, data of 20 lines 
are generated from data of seven lines. 

Embodiment shown in FIG. 16 can be applied 
to the case where higher resolution picture of 1 920 
pixels in lateral direction and 1024 pixels in longitu- 
dinal direction is converted into lower resolution 
picture of 720 pixels in lateral direction and 358 
pixels in longitudinal direction. When down-sam- 
pling of 7/20 times in longitudinal direction is im- 
plemented to 1024 pixels in longitudinal direction, 
the number of pixels obtained is greater than 358 
pixels in longitudinal direction. For this reason, in 
this case, processing for deleting lines at the upper 
or lower end portion of picture, etc. is carried out. 

When an attempt is made to carry out down- 
sampling of 7/20 times in longitudinal direction 
shown in FIG. 16, the number of coefficients for 
weighting is increased, so the circuit configuration 
for calculation processing becomes complicated. In 
view of this, for example, down-sampling of 1/3 
times may be employed in place of the down- 
sampling of 7/20 times. Down-sampling in lateral 
direction in this case has a ratio of 3/8 times. This 
ratio is the same as that in the case shown in FIG. 
16. 



FIG. 19 shows the principle of down-sampling 
of 1/3 times. As shown in this figure, in the first and 
second fields F1 and F2, one lines are thinned 
(extracted) from respective three lines, thereby 

5 making it possible to carry out down-sampling in 
longitudinal direction of 1/3 times. 

In this case, it is necessary to allow up-sam- 
pling in longitudinal direction to have a ratio of 
three times. This can be realized in accordance 

10 with the principle shown in FIG. 20, for example. 
Namely, also in this case, input pixels are multi- 
plied by predetermined coefficients to implement 
weighting thereto to thereby generate data of three 
lines from data of respective one lines in the fields 

15 F1 , F2. 

As stated above, down-sampling of 7/20 times 
and up-sampling of 20/7 times are respectively 
approximated by down-sampling of 1/3 times and 
up-sampling of 3 times, thereby simplifying the 

20 configuration. Thus, low cost apparatus can be 
realized. 

This embodiment can be applied to the case 
where higher resolution picture of 1920 pixels in 
lateral direction and 1024 pixels in longitudinal di- 

25 rection is converted into lower resolution picture of 
720 pixels in lateral direction and 341 pixels in 
longitudinal direction. When down-sampling in lon- 
gitudinal direction is implemented to 1024 pixels in 
longitudinal direction, the number of pixels ob- 

30 tained is greater than 341 pixels in longitudinal 
direction. For this reason, in this case, processing 
for deleting lines at the upper or lower end portion 
of picture is carried out. 

In a manner stated above, it is possible to 

35 respectively encode picture of higher resolution 
and picture of lower resolution to transmit coded 
picture data to decode them. In the case where, 
e.g., optical disc is used as transmission media, 
picture of higher resolution and picture of lower 

40 resolution are recorded onto optical disc. 

FIG. 21 shows a method of manufacturing such 
a disc. Namely, original disc (block) comprised of, 
e.g.. glass is prepared to coat recording material 
comprised of, e.g., photo-resist, etc. thereon. Thus, 

45 recording original disc (block) is made up. On the 
other hand, in a manner as described above, bit 
stream including picture data of higher resolution 
and picture data of lower resolution is once re- 
corded onto, e.g., magnetic tape, etc. in accor- 

50 dance with a predetermined format, thus to make 
up software. 

Such software is edited as occasion demands 
to generate a signal of format to be recorded onto 
optical disc. Laser beams are modulated in cor- 

55 respondence with this recording signal to irradiate 
those laser beams onto photo-resist on the original 
disc (block). Thus, photo-resist on the original disc 
(block) is exposed to light in correspondence with 
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recording signal. 

Thereafter, this original disc is caused to un- 
dergo development processing to allow pits to ap- 
pear on the original disc. Processing, e.g., elec- 
trocasting. etc. is implemented to the original disc 
prepared in this way to make up metallic original 
disc to which pits on the glass original disc are 
transferred. Metallic stamper is further made up 
from the metal original disc to use it as metal mold 
for forming. 

Material such as PMMA (acrylic substance) or 
PC (polycarbonate), otc. is injoctod into tho motal 
mold for forming by using, e.g.. injection, otc. to 
solidify it. Alternatively, 2P (ultraviolet hardening 
resin), etc. is coated onto metallic stamper there- 
after to irradiate ultraviolet rays thereonto to harden 
it. Thus, it is possible to transfer pits on the metal- 
lic stamper onto replica comprised of resin. 

Reflection film is formed by vacuum-deposition 
or sputtering, etc. on the replica produced in this 
way. Alternatively, such reflection film is formed by 
spin-coat. 

Thereafter, processing of inside and outside 
diameters is implemented to this disc to carry out a 
necessary processing to stick two discs together, 
etc. In addition, label is stuck on disc and hub is 
attached thereto. The disc thus obtained is inserted 
into cartridge. Optical disc is completed in this 
way. 

Industrial Applicability 

As stated above, in accordance with the picture 
signal coding method and picture signal coding 
apparatus, and picture signal decoding method and 
picture signal decoding apparatus of this invention, 
picture signal of higher resolution is coded in a 
manner caused to have different aspect ratio and is 
transmitted. The signal thus obtained is decoded. 
Accordingly, it is possible to monitor, e.g., picture 
signal of higher resolution of the high vision system 
by, e.g., image receiver of lower resolution of the 
NTSC system. It is a matter of course that some 
image receivers of the high vision system permit 
pictures of high resolution to be observed as they 
are. 

Further, in image receiver having low resolution 
but such that its aspect ratio is set to, e.g., ratio of 
16:9, if that image receiver has a function to allow 
picture of the squeeze system of aspect ratio of 4:3 
to be picture of the original aspect ratio of 16:9 for 
a second time, it is possible to observe picture of 
normal ratio. 

Furthermore, in the case where picture of lower 
resolution is transmitted as picture of the letter box 
system, also in image receiver of the NTSC sys- 
tem having aspect ratio of 4:3, it is possible to 
observe such a picture as picture of correct ratio 



between length and breadth. In addition, in image 
receiver of the NTSC system having aspect ratio of 
16:9, it is possible to display picture in an extended 
manner over the entirety of screen without inserting 
s lines of substantially non-picture at the upper and 
lower portions of picture. 

Claims 

io 1. A picture signal coding method of generating a 
prodictivo picture signal of a picture signal of 
highor rosolution from a signal obtainod by 
decoding a codod signal of a picture signal of 
lower resolution, and encoding the picture sig- 

76 nal of higher resolution by using the generated 

predictive picture signal, 

the method comprising the steps of: 
up-sampling, at a ratio between the num- 
bers of pixels in longitudinal and lateral direc- 

20 tions different from each other, a signal ob- 

tained by decoding a coded signal of a picture 
signal of lower resolution, thus to generate a 
predictive picture signal of the picture signal of 
higher resolution; and 

25 predictive-coding the picture signal of 

higher resolution by using the generated pre- 
dictive picture signal. 

2, A picture signal coding method as set forth in 
30 claim 1, wherein the picture signal of higher 

resolution is caused to undergo down-sampling 
at a ratio between the numbers of pixels in 
longitudinal and lateral directions different from 
each other, thus to generate the picture signal 
35 of lower resolution. 

3. A picture signal coding method as set forth in 
claim 2, 

the method comprising the steps of: 

40 down-sampling the picture signal of higher 

resolution so that there results any one of 
resolutions of 1/2 times in longitudinal direction 
and 3/8 times in lateral direction, 7/15 times in 
longitudinal direction and 3/8 times in lateral 

45 direction, 7/20 times in longitudinal direction 

and 3/8 times in lateral direction, and 1/3 times 
in longitudinal direction and 3/8 times in lateral 
direction, thus to generate the picture signal of 
lower resolution, and 

so up-sampling a signal obtained by decoding 

a coded signal of of the picture signal of lower 
resolution so that there results a resolution in 
which resolution components in longitudinal 
and lateral directions are inverse numbers of 

55 those of the resolution of the down-sampling. 

thus to generate a predictive picture signal of 
the picture signal of higher resolution. 
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4. A picture signal coding method as set forth in 
claim 1, 

wherein the picture signal of higher resolu- 
tion has 1920 pixels in lateral direction and 960 
pixels in longitudinal direction, and 

wherein the picture signal of lower resolu- 
tion has 720 pixels in lateral direction and 480 
pixels in longitudinal direction. 

5. A picture signal coding method as set forth in 
claim 1, 

wherein the picture signal of higher resolu- 
tion has 1920 pixels in lateral direction and 
1152 pixels in longitudinal direction, and 

wherein the picture signal of lower resolu- 
tion has 720 pixels in lateral direction and 576 
pixels in longitudinal direction. 

6. A picture signal coding method as set forth in 
claim 1, 

wherein the picture signal of higher resolu- 
tion has 1920 pixels in lateral direction and 
1024 pixels in longitudinal direction, and 

wherein the picture signal of lower resolu- 
tion has 720 pixels in lateral direction and 483 
pixels in longitudinal direction. 

7. A picture signal coding method as set forth in 
claim 1, 

wherein the picture signal of higher resolu- 
tion has 1920 pixels in lateral direction and 
1024 pixels in longitudinal direction, and 

wherein the picture signal of lower resolu- 
tion has 720 pixels in lateral direction and 358 
pixels in longitudinal direction. 

8. A picture signal coding method as set forth in 
claim 1, 

wherein the picture signal of higher resolu- 
tion has 1920 pixels in lateral direction and 
1024 pixels in longitudinal direction, and 

wherein the picture signal of lower resolu- 
tion has 720 pixels in lateral direction and 341 
pixels in longitudinal direction. 

9. A picture signal coding method comprising the 
steps of generating a predictive picture signal 
of a picture signal of higher resolution from a 
signal obtained by decoding a coded signal of 
a picture signal of lower resolution, and encod- 
ing the picture signal of higher resolution by 
using the generated predictive picture signal, 

the method comprising the steps of: 
up-sampling a signal obtained by decoding 
a coded signal of a picture signal of lower 
resolution so as to have a resolution of 8/3 
times in longitudinal direction and 8/3 times in 
lateral direction, thus to generate a predictive 



picture signal of the picture signal of higher 
resolution, and 

predictive-coding the picture signal of 
higher resolution by using the generated pre- 
5 dictive picture signal. 

10. A picture signal coding method as set forth in 
claim 9, 

wherein the picture signal of higher resolu- 
10 tion is caused to undergo down-sampling so as 

to have a resolution of 3/8 times in longitudinal 
direction and 3/8 times in lateral direction, thus 
to generate the picture signal of lower resolu- 
tion. 

75 

11. A picture signal coding method as set forth in 
claim 9, 

wherein the picture signal of higher resolu- 
tion has 1920 pixels in lateral direction and 960 
20 pixels in longitudinal direction, and 

wherein the picture signal of lower resolu- 
tion has 720 pixels in lateral direction and 360 
pixels in longitudinal direction. 

25 12. A picture signal coding method as set forth in 
claim 9, 

wherein the picture signal of higher resolu- 
tion has 1920 pixels in lateral direction and 
1152 pixels in longitudinal direction, and 
30 wherein the picture signal of lower resolu- 

tion has 720 pixels in lateral direction and 432 
pixels in longitudinal direction. 

13. A picture signal coding apparatus adapted for 
35 generating a predictive picture signal of a pic- 
ture signal of higher resolution from a signal 
obtained by decoding a coded signal of a 
picture signal of lower resolution to encode the 
picture signal of higher resolution by using the 

40 generated predictive picture signal, 

the apparatus comprising: 
up-sampling means for up-sampling, at a 
ratio between the numbers of pixels in longitu- 
dinal and lateral directions different from each 
45 other, a signal obtained by decoding a coded 

signal of a picture signal of lower resolution, 
thus to generate a predictive picture signal of 
the picture signal of higher resolution; and 
coding means for predictive-coding the 
so picture signal of higher resolution by using the 

generated predictive picture signal. 

14. A picture signal coding apparatus as set forth 
in claim 13, 

55 which further comprises: 

down-sampling means for down-sampling, 
at the ratio between the numbers of pixels in 
longitudinal and lateral directions different from 
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each other, the picture signal of higher resolu- 
tion, thus to generate the picture signal of 
lower resolution. 

15. A picture signal coding apparatus as set forth 5 
in claim 14, 

wherein the down-sampling means carries 
out down-sampling of the picture signal of 
higher resolution so as to have any one of 
resolution of 1/2 times in longitudinal direction to 
and 3/8 times in lateral direction, 7/15 times in 
longitudinal direction and 3/8 times in lateral 
direction, 7/20 times in longitudinal direction 
and 3/8 times in lateral direction, and 1/3 times 
in longitudinal direction and 3/8 times in lateral is 
direction, thus to generate the picture signal of 
lower resolution, and 

wherein the up-sampling means carries out 
up-sampling of a signal obtained by decoding 
a coded signal of the picture signal of lower 20 
resolution so as to have a resolution in which 
resolution components in longitudinal and lat- 
eral directions are inverse numbers of those of 
the resolution of the down-sampling, thus to 
generate a predictive picture signal of the pic- 25 
ture signal of higher resolution. 

16. A picture signal coding apparatus as set forth 
in claim 13. 

wherein the picture signal of higher resolu- 30 
tion has 1920 pixels in lateral direction and 960 
pixels in longitudinal direction, and 

wherein the picture signal of lower resolu- 
tion has 720 pixels in lateral direction and 480 
pixels in longitudinal direction. 35 

17. A picture signal coding apparatus as set forth 
in claim 13, 

wherein the picture signal of higher resolu- 
tion has 1920 pixels in lateral direction and 40 
1152 pixels in longitudinal direction, and 

wherein the picture signal of lower resolu- 
tion has 720 pixels in lateral direction and 576 
pixels in longitudinal direction. 

45 

18. A picture signal coding apparatus as set forth 
in claim 13, 

wherein the picture signal of higher resolu- 
tion has 1920 pixels in lateral direction and 
1024 pixels in longitudinal direction, and so 

wherein the picture signal of lower resolu- 
tion has 720 pixels in lateral direction and 483 
pixels in longitudinal direction. 

19. A picture signal coding apparatus as set forth 55 
in claim 13, 

wherein the picture signal of higher resolu- 
tion has 1920 pixels in lateral direction and 
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1024 pixels in longitudinal direction, and 

wherein the picture signal of lower resolu- 
tion has 720 pixels in lateral direction and 358 
pixels in longitudinal direction. 

20. A picture signal coding apparatus as set forth 
in claim 13, 

wherein the picture signal of higher resolu- 
tion has 1920 pixels in lateral direction and 
1024 pixels in longitudinal direction, and 

wherein the picture signal of lower resolu- 
tion has 720 pixels in lateral direction and 341 
pixels in longitudinal direction. 

21. A picture signal coding apparatus adapted for 
generating a predictive picture signal of a pic- 
ture signal of higher resolution from a signal 
obtained by decoding a coded signal of a 
picture signal of lower resolution to encode the 
picture signal of higher resolution by using the 
generated predictive picture signal, 

the apparatus comprising: 

up-sampling means for up-sampling a sig- 
nal obtained by decoding a coded signal of the 
picture signal of lower resolution so as to have 
resolution of 8/3 times in longitudinal direction 
and 8/3 times in lateral direction, thus to gen- 
erate a predictive picture signal of the picture 
signal of higher resolution, and 

coding means for predictive-coding the 
picture signal of higher resolution by using the 
generated predictive picture signal. 

22. A picture signal coding apparatus as set forth 
in claim 21 , 

wherein the picture signal of higher resolu- 
tion is caused to undergo down-sampling so as 
to have resolution of 3/8 times in longitudinal 
direction and 3/8 times in lateral direction, thus 
to generate the picture signal of lower resolu- 
tion. 

23. A picture signal coding apparatus as set forth 
in claim 21, 

wherein the picture signal of higher resolu- 
tion has 1920 pixels in lateral direction and 960 
pixels in longitudinal direction, and 

wherein the picture signal of lower resolu- 
tion has 720 pixels in lateral direction and 360 
pixels in longitudinal direction. 

24. A picture signal coding apparatus as set forth 
in claim 21, 

wherein the picture signal of higher resolu- 
tion has 1920 pixels in lateral direction and 
1152 pixels in longitudinal direction, and 

wherein the picture signal of lower resolu- 
tion has 720 pixels in lateral direction and 432 
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pixels in longitudinal direction. 

25. A picture signal decoding method comprising 
the steps of generating a predictive picture 
signal of a picture signal of higher resolution 
from a signal obtained by decoding a coded 
signal of a picture signal of lower resolution, 
and decoding a coded signal of the picture 
signal of higher resolution by using the gen- 
erated predictive picture signal, 

the method comprising the steps of: 
up-sampling, at a ratio between the num- 
bers of pixels in longitudinal and lateral direc- 
tions different from each other, a first decoded 
signal obtained by decoding a coded signal of 
a picture signal of lower resolution, thus to 
generate a predictive picture signal of a picture 
signal of higher resolution, and 

predictive-decoding a coded signal of the 
picture signal of higher resolution by using the 
generated predictive picture signal, thus to 
generate a second decoded signal. 

26. A picture signal decoding method as set forth 
in claim 25, 

wherein the first decoded signal is caused 
to undergo up-sampling so that there is pro- 
vided any one of resolutions of 2 times in 
longitudinal direction and 8/3 times in lateral 
direction, 15/7 times in longitudinal direction 
and 8/3 times in lateral direction, 20/7 times in 
longitudinal direction and 8/3 times in lateral 
direction, and 3 times in longitudinal direction 
and 8/3 times in lateral direction, thus to gen- 
erate a predictive picture signal of the picture 
signal of higher resolution. 

27. A picture signal decoding method as set forth 
in claim 25, 

wherein the second decoded signal has 
1920 pixels in lateral direction and 960 pixels 
in longitudinal direction, and 

wherein the first decoded signal has 720 
pixels in lateral direction and 480 pixels in 
longitudinal direction. 

28. A picture signal decoding method as set forth 
in claim 25, 

wherein the second decoded signal has 
1920 pixels in lateral direction and 1152 pixels 
in longitudinal direction, and 

wherein the first decoded signal has 720 
pixels in lateral direction and 576 pixels in 
longitudinal direction. 

29. A picture signal decoding method as set forth 
in claim 25, 

wherein the second decoded signal has 



1920 pixels in lateral direction and 1024 pixels 
in longitudinal direction, and 

wherein the first decoded signal has 720 
pixels in lateral direction and 483 pixels in 
5 longitudinal direction. 

30. A picture signal decoding method as set forth 
in claim 25, 

wherein the second decoded signal has 
io 1920 pixels in lateral direction and 1024 pixels 

in longitudinal direction, and 

wherein the first decoded signal has 720 
pixels in lateral direction and 358 pixels in 
longitudinal direction. 

75 

31. A picture signal decoding method as set forth 
in claim 25, 

wherein the second decoded signal has 
1920 pixels in lateral direction and 1024 pixels 
20 in longitudinal direction, and 

wherein the first decoded signal has 720 
pixels in lateral direction and 341 pixels in 
longitudinal direction. 

25 32. A picture signal decoding method comprising 
the steps of generating a predictive picture 
signal of a picture signal of higher resolution 
from a signal obtained by decoding a coded 
signal of a picture signal of lower resolution, 

30 and decoding a coded signal of a picture sig- 

nal of higher resolution by using the generated 
predictive picture signal, 

the method comprising the steps of: 
up-sampling a first decoded signal ob- 

35 tained by decoding a coded signal of a picture 

signal of lower resolution so as to have a 
resolution of 8/3 times in longitudinal direction 
and 8/3 times in lateral direction, thus to gen- 
erate a predictive picture signal of the picture 

40 signal of higher resolution, and 

predictive-decoding a coded signal of the 
picture signal of higher resolution by using the 
generated predictive picture signal, thus to 
generate a second decoded signal. 

45 

33 A picture signal decoding method as set forth 
in claim 32, 

wherein the second decoded signal has 
1920 pixels in lateral direction and 960 pixels 
so in longitudinal direction, and 

wherein the first decoded signal has 720 
pixels in lateral direction and 360 pixels in 
longitudinal direction. 

55 34. A picture signal decoding method as set forth 
in claim 32, 

wherein the second decoded signal has 
1920 pixels in lateral direction and 1152 pixels 
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in longitudinal direction, and 

wherein the first decoded signal has 720 
pixels in lateral direction and 432 pixels in 
longitudinal direction. 

35. A picture signal decoding apparatus adapted 
for generating a predictive picture signal of a 
picture signal of higher resolution from a signal 
obtained by decoding a coded signal of a 
picture signal of lower resolution to decode a 
coded signal of the picture signal of higher 
resolution by using the generated predictive 
picture signal, 

the apparatus comprising: 

up-sampling means for up-sampling a first 
decoded signal obtained by decoding a coded 
signal of a picture signal of lower resolution at 
a ratio between the numbers of pixels in lon- 
gitudinal and lateral directions different from 
each other, thus to generate a predictive pic- 
ture signal of a picture signal of higher resolu- 
tion, and 

decoding means for predictive-decoding a 
coded signal of the picture signal of higher 
resolution by using the generated predictive 
picture signal, thus to generate a second de- 
coded signal. 

36. A picture signal decoding apparatus as set 
forth in claim 35, 

wherein the up-sampling means carries out 
up-sampling of the first decoded signal so that 
there is provided any one of resolutions of 2 
times in longitudinal direction and 8/3 times in 
lateral direction, 15/7 times in longitudinal di- 
rection and 8/3 times in lateral direction, 20/7 
times in longitudinal direction and 8/3 times in 
lateral direction, and 3 times in longitudinal 
direction and 8/3 times in lateral direction, thus 
to generate a predictive picture signal of the 
picture signal of higher resolution. 

37. A picture signal decoding apparatus as set 
forth in claim 35, 

wherein the second decoded signal has 
1920 pixels in lateral direction and 960 pixels 
in longitudinal direction, and 

wherein the first decoded signal has 720 
pixels in lateral direction and 480 pixels in 
longitudinal direction. 

38. A picture signal decoding apparatus as^ set 
forth in claim 35. 

wherein the second decoded signal has 
1920 pixels in lateral direction and 1152 pixels 
in longitudinal direction, and 

wherein the first decoded signal has 720 
pixels in lateral direction and 576 pixels in 



longitudinal direction. 

39. A picture signal decoding apparatus as set 
forth in claim 35, 

5 wherein the second decoded signal has 

1920 pixels in lateral direction and 1024 pixels 
in longitudinal direction, and 

wherein the first decoded signal has 720 
pixels in lateral direction and 483 pixels in 

10 longitudinal direction. 

40. A picture signal decoding apparatus as set 
forth in claim 35, 

wherein the second decoded signal has 
75 1920 pixels in lateral direction and 1024 pixels 

in longitudinal direction, and 

wherein the first decoded signal has 720 
pixels in lateral direction and 358 pixels in 
longitudinal direction. 

20 

41. A picture signal decoding apparatus as set 
forth in claim 35, 

wherein the second decoded signal has 
1920 pixels in lateral direction and 1024 pixels 
25 in longitudinal direction, and 

wherein the first decoded signal has 720 
pixels in lateral direction and 341 pixels in 
longitudinal direction. 

30 42. A picture signal decoding apparatus adapted 
for generating a predictive picture signal of a 
picture signal of higher resolution from a signal 
obtained by decoding a coded signal of a 
picture signal of lower resolution, thus to de- 

35 code a coded signal of the picture signal of 

higher resolution by using the generated pre- 
dictive picture signal. 

the apparatus comprising: 

up-sampling means for up-sampling a first 

40 decoded signal obtained by decoding a coded 

signal of a picture signal of lower resolution so 
as to have a resolution of 8/3 times in longitu- 
dinal direction and 8/3 times in lateral direc- 
tion, thus to generate a predictive picture sig- 

45 nal of the picture signal of higher resolution, 

and 

decoding means for predictive-decoding a 
coded signal of a picture signal of higher reso- 
lution by using the generated predictive picture 
so signal, thus to generate a second decoded 

signal. 

4a A picture sinal decoding apparatus as set forth 
in claim 42, 

55 wherein the second decoded signal has 

1920 pixels in lateral direction and 960 pixels 
in longitudinal direction, and 

wherein the first decoded signal has 720 
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pixels in lateral direction and 360 pixels in 
longitudinal direction. 

44. A picture signal decoding apparatus as set 

forth in claim 42, 5 

wherein the second decoded signal has 
1920 pixels in lateral direction and 1152 pixels 
in longitudinal direction, and 

wherein the first decoded signal has 720 
pixels in lateral direction and 432 pixels in w 
longitudinal direction. 
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